Command selection policy with read priority

ABSTRACT

Apparatuses and methods related to command selection policy for electronic memory or storage are described. Commands to a memory controller may be prioritized based on a type of command, a timing of when one command was received relative to another command, a timing of when one command is ready to be issued to a memory device, or some combination of such factors. For instance, a memory controller may employ a first-ready, first-come, first-served (FRFCFS) policy in which certain types of commands (e.g., read commands) are prioritized over other types of commands (e.g., write commands). The policy may employ exceptions to such an FRFCFS policy based on dependencies or relationships among or between commands. An example can include inserting a command into a priority queue based on a category corresponding to respective commands, and iterating through a plurality of priority queues in order of priority to select a command to issue.

PRIORITY INFORMATION

This application is a Continuation of U.S. application Ser. No.15/951,896, filed Apr. 12, 2018, the contents of which are includedherein by reference.

TECHNICAL FIELD

The present disclosure relates generally to memory, and moreparticularly, to apparatuses and methods associated with commandselection policy with read priority.

BACKGROUND

Memory devices are typically provided as internal, semiconductor,integrated circuits in computers or other electronic devices. There aremany different types of memory including volatile and non-volatilememory. Volatile memory can require power to maintain its data andincludes random-access memory (RAM), dynamic random access memory(DRAM), and synchronous dynamic random access memory (SDRAM), amongothers. Non-volatile memory can provide persistent data by retainingstored data when not powered and can include NAND flash memory, NORflash memory, read only memory (ROM), Electrically Erasable ProgrammableROM (EEPROM), Erasable Programmable ROM (EPROM), and resistance variablememory such as phase change random access memory (PCRAM), resistiverandom access memory (RRAM), and magnetoresistive random access memory(MRAM), among others.

Memory is also utilized as volatile and non-volatile data storage for awide range of electronic applications. Non-volatile memory may be usedin, for example, personal computers, portable memory sticks, digitalcameras, cellular telephones, portable music players such as MP3players, movie players, and other electronic devices. Memory cells canbe arranged into arrays, with the arrays being used in memory devices.

Various computing systems include a number of processing resources thatare coupled to memory (e.g., a memory system), which is accessed inassociation with executing a set of instruction (e.g., a program,applications, etc.). A memory system can implement a scheduling policyused to determine an order in which memory access requests (e.g., readand write commands) received from the processing resource(s) areexecuted by the memory system. Such scheduling policies can affectcomputing system performance since program execution time on thecomputing system is affected by the execution time of the respectivememory access requests, for example.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an apparatus in the form of a computingsystem including a memory system and capable of implementing a commandselection policy in accordance with a number of embodiments of thepresent disclosure.

FIG. 2 is a timing diagram for command selection in accordance with anumber of embodiments of the present disclosure.

FIG. 3 is a block diagram of an issue unit of a controller capable ofimplementing a command selection policy in accordance with a number ofembodiments of the present disclosure.

FIG. 4 illustrates a flow chart associated with implementing a commandselection policy in accordance with a number of embodiments of thepresent disclosure.

FIGS. 5A, 5B, and 5C illustrate a flow chart associated withimplementing a command selection policy in accordance with a number ofembodiments of the present disclosure.

DETAILED DESCRIPTION

The present disclosure includes apparatuses and methods related tocommand selection policy. An example method can include receiving a readcommand to a memory controller, wherein the read command comprises anaddress for a bank and a channel of a memory device, inserting the readcommand into a queue of the memory controller, blocking a first numberof write commands to the bank, issuing, to the memory device, anactivation command associated with the read command, blocking a secondnumber of write commands to the channel, and issuing the read command tothe memory device. As used herein, blocking commands can also bereferred to as deprioritizing commands.

A number of embodiments of the present disclosure can provide animproved command selection policy as compared to previous approaches.For instance, some prior command selection policies include FCFS(first-come, first-served) and FRFCFS (first-ready, first-come,first-served). A FCFS policy can include scheduling commands received toa memory controller for execution by a memory device (e.g., a mainmemory such as a DRAM device) based on the order in which the commandswere received by (e.g., decoded) the controller. Therefore, in suchcases, oldest commands are executed first. However, various memorysystems include timing constraints that can affect whether a command canbe issued (e.g., from the memory controller to the memory device). Forexample, various support circuitry associated with a memory array (e.g.,row decode circuitry, column decode circuitry, sense amplifiercircuitry, pre-charge circuitry, refresh circuitry, etc.) can includetiming constraints that determine when/if a particular command is readyfor execution by the memory device. Accordingly, a FCFS policy canincrease execution latency since a newer command may be ready forissuance to the memory device (e.g., based on the timing constraints)but the command cannot be sent to the memory device until the oldercommand is executed.

A FRFCFS policy can reduce latency as compared to a FCFS policy. Forexample, in the FRFCFS policy, a memory controller may iterate throughthe command queue and select the first command it encounters that isready to be issued. Therefore, an older command not yet ready may beskipped over in favor of a newer pending command that is ready.

As an example, a FRFCFS policy may include prioritizing column commandsover row commands such that the policy includes searching the commandqueue for the oldest column command ready to be issued and if anissuable column command is not found, the oldest row command that isready to be issued is selected for issuance to the memory device. Asthose skilled in the art appreciate, memory and storage arrays may beorganized logically or physically, or both, in columns and rows. So, asused herein, a “column” command refers to a command directed to anaddress corresponding to an open (e.g., activated) row (e.g., page) ofan array of the memory device, and a “row” command refers to a commanddirected to an address corresponding to a closed (e.g., deactivated) rowof the array.

In some implementations, neither a FCFS policy nor a FRFCFS policyprioritizes read commands (e.g., over write commands). Prioritizing readcommands can improve system performance since various instructionsexecuted by a processing resource (e.g., a central processing unit) canbe dependent on execution of other instructions. For example, variousinstructions to be executed by a CPU may be dependent upon a readcommand issued to a memory system. Therefore, the dependent instructionsin such implementations might not be executed by the CPU until the datacorresponding to the read command is returned to the CPU. As such, delayin execution of read commands sent to the memory system can result indelay in program execution.

A number of embodiments of the present disclosure can implement acommand selection policy that prioritizes read commands (e.g., bothcolumn read commands and row read commands) over write commands, whichcan provide benefits such as reducing latency associated with readaccess requests to memory, among other benefits. As described furtherherein, a number of embodiments include implementing a command selectionpolicy that has similarities to a FRFCFS policy along with a strict readpriority. A number of embodiments can be implemented via execution ofinstructions stored on machine-readable media, which can include variousnon-transitory media including, but not limited to, volatile and/ornonvolatile memory, such as solid-state memories, phase-change memory,ferroelectric memory, optical media, and/or magnetic media among othertypes of machine readable media.

With a strict read priority policy, if the memory controller is in theprocess of issuing write commands and one or more read commands enter aqueue (e.g., command queue), the memory controller can cease issuingwrite commands to service the read commands. Although, a strict readpriority can lead to low latency for the read commands due to variousfactors, the read commands may not be ready for immediate issuance atthe time that they enter the queue. A policy in which a memorycontroller blocks write commands can leave a bus unnecessarily idle. Forexample, a bus can be unnecessarily idle between a time in which thememory controller blocks a write command and a time when a read commandis ready to issue.

Upon adding a read command to the queue, the memory controller can blockoutstanding writes that are ready to issue even though the read commandis not ready to issue. The memory controller can cease issuing furtherwrite commands causing a duration of time in which the bus is idle.During the idle bus time the memory controller can issue pre-charge(“PRE”) commands and/or activate (“ACT”) command to prepare the memorydevice for the read command. The memory controller can unnecessarilycease issuing write commands given that the read command is not readyfor issuance. The pre-charge commands can be a row pre-charge command.

Some embodiments can prevent the memory controller from unnecessarilyceasing to issue write commands. For example, the memory controller cancease issuing write commands if read commands are ready to be issued.However, timing constraints of a memory device can dictate that pendingwrite commands become issuable before pending read commands becomeissuable if a most recently issued command was a write command.

The memory controller may continue to issue the write commands untilthere are no write commands left in a queue, at which point the memorycontroller may issue the read. An unintended effect of the decision todelay blocking the write commands is that the read command may no longerreceive priority over the write commands. The issuance of the readcommand may be further delayed if additional write commands are added tothe queue and become issuable before the pending read command becomesissuable. Delaying the issuance of the read command to issue the writecommands and continuing to issue write command until the write commandsin a queue are processed may be referred to as “read starvation.” Thatis, read starvation can describe the delaying of blocking write commandswhich can result in further undesirable delays for issuing a readcommand given that new issuable write commands may be added to a queueand become issuable before the pending read command becomes issuable.

Another challenge is that, although the memory device may be in a statein which it can allow a read command to an open row, there may bepending read commands to closed rows. These read commands may not becomeissuable until their associated rows are opened. If a bank which isbeing accessed by a read command has a row open other than the rowaccessed by that read command, then the controller may issue apre-charge command to the row accessed by the read command of the bankprior to issuing the read command.

The command selection policy may force the pre-charge commands andactivate commands to prepare for the pending reads, while allowing theissuing of write commands, provided that they don't delay the pre-chargecommands, the activate commands, and the read commands to anunacceptable degree. That is, the command selection policy can enforce aread command priority for read commands to specific channels and/orbanks while allowing the issuance of write commands to differentchannels and/or banks.

The command selection policy and the examples described herein can beimplemented using DRAM devices, ferroelectric random access memory(FeRAM) devices, and 3D)(Point™ (3DXP) devices, among other types ofmemory.

In the following detailed description of the present disclosure,reference is made to the accompanying drawings that form a part hereof,and in which is shown by way of illustration how a number of embodimentsof the disclosure may be practiced. These embodiments are described insufficient detail to enable those of ordinary skill in the art topractice the embodiments of this disclosure, and it is to be understoodthat other embodiments may be utilized and that process, electrical,and/or structural changes may be made without departing from the scopeof the present disclosure. As used herein, the designator “N” indicatesthat a number of the particular feature so designated can be includedwith a number of embodiments of the present disclosure.

As used herein, “a number of” something can refer to one or more of suchthings. For example, a number of memory devices can refer to one or moreof memory devices. A “plurality” of something intends two or more.Additionally, designators such as “N,” as used herein, particularly withrespect to reference numerals in the drawings, indicates that a numberof the particular feature so designated can be included with a number ofembodiments of the present disclosure.

The figures herein follow a numbering convention in which the firstdigit or digits correspond to the drawing figure number and theremaining digits identify an element or component in the drawing.Similar elements or components between different figures may beidentified by the use of similar digits. As will be appreciated,elements shown in the various embodiments herein can be added,exchanged, and/or eliminated so as to provide a number of additionalembodiments of the present disclosure. In addition, the proportion andthe relative scale of the elements provided in the figures are intendedto illustrate various embodiments of the present disclosure and are notto be used in a limiting sense.

FIG. 1 is a block diagram of an apparatus in the form of a computingsystem including a memory system 120 and capable of implementing acommand selection policy in accordance with a number of embodiments ofthe present disclosure. As used herein, an “apparatus” can refer to, butis not limited to, a variety of structures or combinations ofstructures, such as a circuit or circuitry, a die or dice, a module ormodules, a device or devices, or a system or systems. For example,controller 104, host 102, system 120, and/or devices 110-1 to 110-N mayseparately be referred to as an “apparatus.”

The system 120 can comprise multiple channels each having a number ofdevices 110-1 to 110-N corresponding thereto. The devices 110-1 to 110-Ncan collectively be referred to as devices 110. Each of the devices 110can be, for example, a “chip” comprising multiple banks. The controller104 can service multiple memory channels or the controller 104 can beimplemented as multiple separate controllers (e.g., one for eachchannel). For example, the system 120 can comprise a plurality ofmodules (e.g., dual in-line memory modules (DIMMs)).

In this example, the computing system includes a host 102 coupled to acontroller 104 (e.g., via an interface 103), which is coupled to thememory system 120 (e.g., via an interface 105). The computing system canbe a laptop computer, personal computers, digital camera, digitalrecording and playback device, mobile telephone, PDA, memory cardreader, interface hub, sensor, Internet-of-Things (IoT) enabled device,among other systems, and the host 102 can include a number of processingresources (e.g., one or more processors) capable of accessing memory 120(e.g., via controller 104). The host 102 may be responsible forexecution of an operating system (OS) and/or various applications thatcan be loaded thereto (e.g., from memory system 120 via controller 104).

The controller 104 may receive memory access requests (e.g., in the formof read and write commands, which may be referred to as load and storecommands, respectively) from the host 102. The controller 104 cantransfer commands and/or data between the host 102 and the memory system120 over the interfaces 103 and 105, which can comprise physicalinterfaces such as buses, for example, employing a suitable protocol.Such protocol may be custom or proprietary, or one or both interfaces103 and 105 may employ a standardized protocol, such as PeripheralComponent Interconnect Express (PCIe), Gen-Z, CCIX, or the like.

As an example, the interfaces 103 and 105 may comprise combined address,command, and data buses or separate buses for respective address,command, and data signals. The controller 104 can comprise controlcircuitry, in the form of hardware, firmware, or software, or anycombination of the three. As an example, the controller 104 can comprisea state machine, a sequencer, and/or some other type of controlcircuitry, which may be implemented in the form of an applicationspecific integrated circuit (ASIC) coupled to a printed circuit board.In a number of embodiments, the controller 104 may be co-located withthe host 102 (e.g., in a system-on-chip (SOC) configuration). Also, thecontroller 104 may be co-located with the memory system 120. Thecontroller 104 can be, for example, a controller such as a controllercomprising issue unit 322 in FIG. 3 and can be configured to implement acommand selection policy in accordance with a number of embodiments ofthe present disclosure as described further below.

As shown in FIG. 1, the memory system 120 includes a number of memorydevices 110-1, 110-2, . . . , 110-N, which may be referred tocollectively as memory 110. The memory 110 can comprise a number ofphysical memory “chips,” or dice which can each include a number ofarrays (e.g., banks) of memory cells and corresponding support circuitry(e.g., address circuitry, I/O circuitry, control circuitry, read/writecircuitry, etc.) associated with accessing the array(s) (e.g., to readdata from the arrays and write data to the arrays). As an example, thememory devices 110-1 to 110-N can include a number of DRAM devices, SRAMdevices, PCRAM devices, RRAM devices, FeRAM, phase-change memory, 3DXP,and/or Flash memory devices. In a number of embodiments, the memorysystem 110 can serve as main memory for the computing system.

FIG. 2 is a timing diagram 200 for command selection in accordance witha number of embodiments of the present disclosure. The timing diagram200 shows signals 212 (COMMAND), 211 (CMD/ADDR_BUS_BUSY_), 214(NUM_CMD_QUEUE_ENTRIES), 216 (NUM_READS), 218 (NUM_WRITES), 217(BANK_ADDRESS), and 220 (DATA_BUS_BUSY).

Signal 212 indicates commands provided from a memory controller (e.g.,104) to a memory device (e.g., 110). The commands corresponding tosignal 212 can include activation commands (ACT), pre-charge commands(PRE), read commands, and/or write commands, among other possiblecommands that the controller can provide to the memory device. Signal211 indicates a command/address bus status associated with executingcommands. Signal 214 indicates the quantity of entries (e.g., read andwrite commands) in a command queue. Signal 216 indicates the quantity ofpending read commands in the queue (e.g., commands remaining to beissued). Signal 218 indicates the quantity of pending write commands inthe queue. Signal 217 indicates the bank address to which commands aredirected. Signal 220 indicates a data bus status corresponding to a databus between the controller and the memory device (e.g., a data bus ofinterface 105 shown in FIG. 1).

In accordance with various embodiments of the present disclosure, anissue unit (e.g., 322) of a memory controller can block the issuance ofwrite commands on a channel of a memory device in two stages, which canprevent unnecessarily ceasing issuance of write commands in order toissue a prioritized read command. As shown in FIG. 2, a read command isadded to a queue (e.g., signal 216 transitions from “0” to “1” andsignal 214 transitions from “6” to “7” as shown at 203-1). In thisexample, the read and write commands access a same bank, which may bereferred to as bank “B.” Prior to receiving the read command thecontroller receives and issues write commands 202-1. Responsive toreceiving the read command, the issue unit can block further writecommand issuances to that bank and issue a pre-charge command 204 (e.g.,at time 203-2) and an activation command 206 (e.g., at time 203-3) tomake the received read issuable. After issuing the activation command206 (e.g., to the target row), the issue unit can block write commandissuances to the corresponding channel (e.g., at time 203-4). Blockingwrite command issuances to the channel can allow the read command toeventually become issuable 208 (e.g., while avoiding read starvation dueto subsequent writes to the channel). Once the read becomes issuable,the issue unit selects and issues the read command 208 (at time 203-5).

In a number of embodiments, timing constraints associated with a memorydevice may prevent a read from becoming issuable immediately after itsactivation command (e.g., 206) issues. Therefore, in order to avoid gapsin data bus activity, it may be beneficial to delay blocking of thechannel until a particular amount of time has passed since the issuanceof the activation command. In a number of embodiments, the delay may beequal to a difference between t_(RCD) (row-to-column delay) and t_(WTR)(write-to-read delay) (e.g., t_(RCD)−t_(WTR)), where t_(RCD) correspondsto the number of clock cycles between opening a row and accessingcolumns within it, and t_(WTR) corresponds to the number of clock cyclesrequired between a valid write command and a next read command. Forinstance, as shown in FIG. 2, a write command 202-3 is issued to thechannel subsequent to the activation command 206, which would not bepossible if the controller had blocked the channel immediatelysubsequent to issuance of the activation command 206. Accordingly, theexample shown in FIG. 2 illustrates a write command 202-3 being issuedsometime before expiration of the wait time t_(RCD)−t_(WTR).

To enable the implementation of the wait time (e.g., t_(RCD)−t_(WTR))associated with blocking the channel, the issue unit may retain atimestamp for each activation command (e.g., 206). Accordingly, areceived read command will not result in blocking of the channel untilt_(RCD)−t_(WTR) has passed since the corresponding activation command206 has issued.

The timing diagram 200 shows a timing of command issuances usingseparate bank and channel blockings. For example, the particular bank towhich the received read command is directed may be blocked responsive toreceiving the read command. However, as shown, the issue unit maycontinue to issue write commands (e.g., 202-2) to other banks of thechannel prior to blocking all writes to the channel, which can reduceidle time of the data bus (e.g., as shown by signal 220). Subsequent toissuing the activation command 206, the issue unit can block writes tothe channel. However, as noted above, bus idle time can be furtherreduced by delaying the blocking of the channel until after timet_(RCD)−t_(WTR) has passed since issuance of the activation command 206(e.g., as indicated by issuance of write command 202-3).

As shown in FIG. 2, the read command 208 is given priority overpreviously received (e.g., “older”) write commands in order to reduceread latency. For example, as indicated by signals 214 and 218, despitebeing received by the issue unit prior in time to the read command, theissuance of write commands 202-4 is delayed until after issuance of theread command.

Utilizing a read priority command selection policy can involve thememory controller elevating the priority of write commands when one ormore newer read commands access a same row as the write (e.g., due to a“read-after-write dependence”). Accounting for read-after-writedependence in association with a read priority command selection policycan result in issuing dependent read commands (e.g., commands that arenot to issue until after one or more subsequently received writes to thesame row) sooner than they would otherwise have issued. For the purposesof the scheduling policy described herein, a write command that iselevated in priority (e.g., due to a read-after-write dependence) can begiven a same priority as a read command.

However, to avoid violating timing constraints of a memory device, thedelay time associated with blocking the channel (e.g., the delaysubsequent to issuance of the row activation command) can be adjustedfor elevated write commands (e.g., as compared to read commands). Forexample, for elevated write commands, the delay can be t_(RCD)−t_(CCD)rather than t_(RCD)−t_(TWR) where t_(CCD) is the column-to-column delay(e.g., the number of clock cycles required between successive writes toan activated row). Example command selection policies such as thatdescribed in FIG. 2 (e.g., policies that include read priority inassociation with bank and channel blocking), are described in furtherdetail below in association with FIGS. 3-6. Various embodiments providebenefits such as reducing bus idle time as compared to some previouscommand selection policies providing read priority.

A command whose execution priority level has been elevated (e.g., aspart of a command selection policy) can be referred to as an elevatedcommand. For example, an elevated write command can refer to a writecommand whose execution priority level is elevated as compared to otherwrite commands in a command queue (e.g., due to a read-after-writedependence associated with the write command).

In various instances, a read command can be directed to a bank in whicha read-after-write dependence is occurring. In such cases, the readcommand can involve sending a pre-charge command to the bank in order toactivate the row to which the read is directed. However, due to theread-after-write dependence occurring on the bank, it can be preferableto allow write command(s) to the row to occur so that the read commandhaving the dependence can execute. Accordingly, embodiments of thepresent disclosure can include blocking pre-charge commands to banksthrough which a read-after-write dependence is occurring.

FIG. 3 is a block diagram of an issue unit 322 of a controller (e.g.,104) capable of implementing a command selection policy in accordancewith a number of embodiments of the present disclosure (e.g., such asthose described in association with FIGS. 4-6). The issue unit 322includes a decoder 328, a bank unit 330, a time unit 332, a commandqueue 334, command selection logic 324, a system timer 336, a bank stateunit 338, and a bus 340 to a memory device.

The issue unit 322 can receive incoming commands 326 (e.g., read and/orwrite commands). The commands 326 can be placed in a command queue 334and their corresponding addresses (e.g., rank address, bank address,etc.) can be decoded by the decoder 328. The bank unit 330 can provideindications (e.g., via one or more lists) of those banks havingparticular characteristics. For example, bank unit 330 can indicate bankaddresses (e.g., bank IDs) associated with outstanding read commandsand/or elevated write commands.

The command queue 334 can comprise one or more queues. For example, thecommand queue 334 can comprise a first queue configured to receive theincoming commands 326 and a number of “prioritized” queues. As anexample, the command selection logic 324 can be configured to place eachof the incoming commands 326 into one of a plurality of queues indexedin priority order. For instance, a highest priority queue might includecolumn read commands, a second highest priority queue might include rowread commands, a third highest priority queue might include column writecommands, and a fourth highest priority queue might include row writecommands. Commands can be placed in the prioritized queues in accordancewith various command selection policies such as those described herein.The command queue 334 can be, for example, a first-in first-out (FIFO)queue(s).

As used herein, the term “queue” is not intended to be limited to aspecific data structure implementation, but rather the term queue canrefer to a collection of elements organized in various manners and whichcan have characteristics of one or more different types of queues and/orlists (e.g., a list, a linked list, etc.), among others.

The system timer 336 provides the time (e.g., 0 picosecond (ps), 1 ps, 2ps, etc.), while the command selection logic 324 and/or time unit 332samples the times from the system timer 336, logs the sampled times, anduses the sampled times in conjunction with the device's timingparameters (e.g., timing parameters associated with operating the memorydevices 340 or other components of the system comprising the memorydevices 340 and issue unit 322), to determine the issuability of theoutstanding commands.

Such timing parameters can include timing constraints such as thosedescribed above (e.g., t_(RCD), t_(WTR), t_(CCD) etc.). The time unit332 can provide timestamps for use in implementing the command selectionpolicy. For example, the time unit 332 can provide timestamps for rowactivation commands, which can be used in association with determiningsuitable times at which to perform channel blocking. The bank state unit338 can indicate the state of various banks corresponding to the memorydevices 340. For instance, the bank state unit 338 can indicate whetherbanks are currently blocked.

The command selection logic 324 is configured to implement commandselection policies described herein. For example, in operation, thecommand selection logic 324 is configured to maintain the listsassociated with bank unit 330 and command queue 334. The command queue334 selects commands (e.g., from command queue 334) for issuance tomemory devices 340 based on input from various components. The commandselection logic 324 can select the commands 326 stored in the commandqueue 334 for issuance using the row activation times provided by thetime unit 332, the bank states provided by the bank states unit 338, thelist of banks provided by the bank unit 330, and data provided by thedecoder 328 and the system timer 336.

In some examples, the command selection logic 324 is configured tocommunicate with the decoder 328. For example, the command selectionlogic 324 can request banks and/or rows associated with the commands326. The command selection logic 324 can also request a list of banksand/or rows with outstanding read commands and/or elevated writecommands from the bank unit 330. That is, the bank unit 330 can storebank and/or row data associated with the commands 326. The commandselection logic 324 can compare a bank and/or row received from thedecoder 328 and corresponding to a command 326 to a list of banks and/orrows provided by the bank unit 330 to determine whether aread-after-write dependence exists. In some examples, theread-after-write dependence can be a function of the row address of thecommands 326 rather than the bank address of the commands.

The command selection logic 324 can also log times associated withcommands using the time unit 332 and the system timer 336. For example,the command selection logic 324 can receive a first time provided by thesystem timer 336 and associate the time with an activation command. Thecommand selection logic 324 can also receive a second time provided bythe system timer 336 to determine whether a duration of time has expiredsufficient to issue a read command and/or to block write commands fromissuing. The command selection logic 324 can request times associatedwith activation commands and can update times associated with activationcommands. For example, the command selection logic 324 can provide anidentifier (ID) associated with an activation command and/or a timeassociated with the activation command and/or the activation command IDto store and/or update a time associated with an activation command. Thecomponents of the issue unit 322 can comprise hardware, firmware, and/orsoftware.

FIG. 4 illustrates a flow chart 442 associated with implementing acommand selection policy in accordance with a number of embodiments ofthe present disclosure. The method described in the flow chart 442 canbe executed, for example, by an issue unit such as issue unit 322 shownin FIG. 3.

At 444, a command enters the queue (e.g., a command queue 334). At 446,a determination is made regarding whether the command is a read command.If the command is not a read command (e.g., the command is a writecommand), no further action is necessary and the method shown in flowchart 442 terminates at 456.

Responsive to a determination (e.g., at 446) that the command is a readcommand, at 448 a determination is made regarding whether the bank IDassociated with the read command is in a list of banks with outstandingread commands and/or elevated write commands (e.g., the bank ID of theread command is compared with the list of bank IDs in a bank unit suchas 330 shown in FIG. 3). Responsive to a determination that the bank IDassociated with the read command is in the list of banks, flow continuesto 452 where a determination is made regarding whether the queuecontains any older writes to the same row as the row to which the readis directed (e.g., in order to determine whether a read-after-writedependence exists for the read command).

Responsive to a determination (e.g., at 448) that the bank ID of theread is not on the list of banks with outstanding read commands and/orelevated write commands, at 450 the bank ID is added to the list ofbanks with outstanding read commands and/or elevated write commands(e.g., the list maintained by a bank unit such as 330), and the flowcontinues to 452 where a read-after-write dependence check is made.

As used herein, the terms “old” and “new” are used to reference therelative time commands have been in the command queue. For example,referring to a command as “older” relative to other commands indicatesit entered the command queue prior to the other commands. For instance,commands entering the command queue (e.g., at 444) will be newer thanthose commands already in the command queue.

Responsive to determining (e.g., at 452) that one or more older writecommand accesses a same row as the read command (e.g., such that aread-after-write dependence exists), at 454 each such older writecommand is marked as an elevated write command (e.g., the priority ofthose write commands is increased in order to ensure they issue prior tosome other read commands that may otherwise have higher priorityaccording to the selection policy), and the flow terminates as shown at456. Responsive to determining (e.g., at 452) that no older writecommands access the same row as the read command (e.g., noread-after-write dependence exists), flow terminates as shown at 456.

FIGS. 5A, 5B, and 5C illustrate a flow chart 560 associated withimplementing a command selection policy in accordance with a number ofembodiments of the present disclosure. FIGS. 5A and 5B illustrate anexample of one iteration through outstanding commands (e.g., from oldestto newest) currently in a command queue (e.g., command queue 334) andselecting a particular one of the commands to issue (e.g., based on aFRFCFS policy with a strict read priority). FIGS. 5A and 5B arecontinuous through cutline 581. FIG. 5C illustrates actions that can betaken subsequent to selecting a command for issuance in accordance witha number of embodiments of the present disclosure.

As shown in FIG. 5A, the command selection iteration can begin, as shownat 562 (e.g., issue unit starts), with initiation (e.g., waking up) ofthe issue unit (e.g., 322). At 563 an index “i” is initialized (to “0”),and the flow shown in FIGS. 5A and 5B executes as each of i commands inthe queue are evaluated. At 564 it is determined whether all of thecommands in the command queue (e.g., command queue 334) have beenevaluated for the particular iteration. Once all the commands have beenevaluated, the condition 564 is met (e.g., i equals the quantity ofcommands in the queue) and one of the commands in the queue is selectedfor issuance according to a particular selection policy (e.g., as shownat 590). If there are commands in the queue remaining to be evaluatedfor a particular iteration (e.g., i does not equal the quantity of thecommands in the queue), then flow moves to 566.

At 566, a determination is made as to whether command i (e.g., the“i^(th)” command) is not a read command, whether the i^(th) command isnot an elevated write command, and whether a bank ID corresponding tothe i^(th) command is in the list of banks with outstanding readcommands and/or elevated write commands (e.g., a list maintained by bankunit 330).

If it is determined that the i^(th) command is not a read command, thei^(th) command is not an elevated write command, and the bank IDassociated with the ith command is in the list of banks with outstandingread commands and/or elevated write commands, then a bank block isexecuted at 574 and command i is marked as not issuable as shown at 576.A bank block refers to the issue unit (e.g., 322) blocking particularcommands from issuing to a particular bank even the commands mayotherwise be issuable (e.g., ready to issue) according to a selectionpolicy. As shown at 572, the index i is incremented (e.g., i=i+1) andthe flow returns to 564.

Responsive to a determination that command i is a read command, commandi is an elevated write command, or the bank ID associated with command iis not in the list of banks with outstanding read commands and/orelevated write commands, a determination regarding whether command i isa read command or whether command i is an elevated write command is made(e.g., at 568 and 570, respectively). If command i is a read command,the flow proceeds to 578 where it is determined whether the read commandi has a read-after-write dependence. If the read command i has aread-after-write dependence, then the read command i is marked as notissuable at 576 and flow proceeds to 572 with an increment to index i.

If the read command i does not have a read-after-write dependence (asdetermined at 578), then flow continues to 582. At 582 it is determinedwhether a read command “R” exists that has a read-after-write dependencethrough the same bank as the bank to which the read command i isdirected and where the R's row is open. If such a read exists, then at576 the read command i is marked as not issuable (e.g., such that apre-charge command corresponding to the read command i is blocked fromissuing to the bank), such that read command R (and the writes on whichit depends) can proceed prior to issuance of the pre-charge commandcorresponding to read command i. If such a read command R does not exist(e.g., as determined at 582), then flow proceeds to 584. At 584 adetermination is made regarding whether time t_(RCD)−t_(WTR) has passedsince an activation of read command i's row (e.g., via an activationcommand ACT).

If time t_(RCD)−t_(WTR) has not passed since activation of read commandi's row, then flow proceeds with incrementing index i at 572. If timet_(RCD)−t_(WTR) has passed since activation of read command i's row,then the channel is blocked at 586 and all commands in the queue otherthan read commands and elevated write commands are marked as notissuable at 588, and flow proceeds to 590. Executing the channel blockat 586 prevents further commands to the channel from issuing until theread command i (or it's corresponding ACT and/or PRE command) hasissued. As described above, prior to the passing of time t_(RCD)−t_(WTR)since read command i's row being activated, write commands may continuebeing issued to other banks of the channel (e.g., even though writes toread command i's bank may be blocked).

Responsive to a determination (e.g., at 570) that command i is anelevated write command, a determination as to whether timet_(RCD)−t_(CCD) has passed since an activation of write command i's row(e.g., via an ACT command). If time t_(RCD)−t_(CCD) has expired, thenthe channel is blocked at 586 and all commands in the queue other thanread commands and elevated write commands are marked as not issuable at588, and flow proceeds to 590. If time t_(RCD)−t_(CCD) has not passedsince activation of write command i's row, then flow proceeds withincrementing index i at 572.

Responsive to iterating through the commands in the queue, as describedabove, the issue unit selects a command “C” for issuance (e.g., at 590).Command C can be selected from among column commands such as readcommands and write commands, as well as row commands such as activationcommands (ACT) and pre-charge commands (PRE) corresponding to readsand/or writes. As shown at 590, the command C can be selected inaccordance with a FRFCFS read priority policy such as those describedherein.

As shown at 591, a determination can be made as to whether selectedcommand C is an activation command (ACT). As shown at 594, if theselected command C is an activation command, then the current time isadded to a list of bank activation times (e.g., such as described abovein association with time unit 322), and flow continues to 598 (e.g.,with issuance of the activation command to the target bank).

As shown at 592, a determination can be made as to whether selectedcommand C is a pre-charge command (PRE). As shown at 595, if theselected command C is a pre-charge command (PRE), then the activationtime corresponding to command C's bank is removed from the list of bankactivation times, and flow continues to 598 (e.g., with issuance of thepre-charge command to the target bank).

As shown at 593, a determination can be made as to whether selectedcommand C is a read command or an elevated write command. As shown at596, if the selected command C is a read or an elevated write, then adetermination is made at 596 regarding whether the queue contains anyother reads or elevated writes to command C's bank. If the queuecontains more reads or elevated writes to the same bank as command C,then flow continues to 598 and selected command C (e.g., the read orelevated write) issues. If it is determined at 596 that the queue doesnot contain more reads or elevated writes to command C's bank, then flowcontinues to 597 and the bank ID corresponding to command C's bank isremoved from the list of banks with reads and/or elevated writes (e.g.,a list such as that described in association with bank unit 330) and theselected command C (e.g., the read or elevated write) issues at 598.

The examples show in FIGS. 2 to 5 are provided for memory devices usingrow and column based addressing such as DDR4, DDR5, and/or FeRAMdevices. Although 3DXP devices do not fall into this class of devices,the embodiments can be modified to allow application to 3DXP devices.

While the devices that use row and column based addressing are composedof banks, where each bank can have one row active at a time, the 3DXPdevices are composed of partitions, where partitions do not comprise rowaddressing nor row activation commands. While the DRAM devices and FeRAMdevices have the timing parameter t_(RCD) to specify a time requiredbetween sending a row command and sending a column command, as well asthe timing parameter t_(WTR) for specifying the minimum time betweensending a write command and a read command, an 3DXP device does not havesaid timing parameters. Rather, 3DXP has timing parameters that specifythe minimum time required between commands to the same partition andcommands to different partitions.

The timing parameters can include t_(WR2WR_SAMEPART) to describe a timeto perform two write operations to a same partition, t_(WR2WR_DIFFPART)to describe a time to perform two write operations to differentpartitions, t_(RD2RD_SAMEPART) to describe a time to perform two readoperations to a same partition, t_(RD2RD_DIFFPART) to describe a time toperform two read operations to different partitions, t_(WR2RD_SAMEPART)to describe a time to perform a write operation and a read operation toa same partition, t_(WR2RD_DIFFPART) to describe a time to perform awrite operation and a read operation to different partitions,t_(RD2WR_SAMEPART) to describe a time to perform a read operation and awrite operation to a same partition, t_(RD2WR_DIFFPART) to describe atime to perform a read operation and a write operation to differentpartitions, and t_(DQ_TURN_AROUND) to describe a time penalty forturning a bus around.

For a given permutation of two commands (e.g., two read commands, twowrite commands, a read command followed by a write command, and/or awrite command followed by a read command), the time (e.g., minimum time)used to send those two commands to the same partition is greater thanthe time to send two commands to different partitions. Due to this,sending a non-elevated write command to a partition for which there isan outstanding read command and/or an elevated write command, can beavoided, as sending the non-elevated write command can incur delays inthe issuance of the read commands and/or elevated write commands. Thebank blocking examples used herein can be applied to 3DXP devices byblocking partitions in the same manner that banks are blocked.

However, blocking partitions can be different than blocking banks asapplied to 3DXP devices given that the time parameter at which thechannel block is applied is a function of row activation times andeither t_(RCD) and t_(WTR) in the case of a channel block for a readcommand or t_(RCD) and t_(CCD) (in the case of a channel block for anelevated write). Given that 3DXP devices have neither row activationsnor associated timing parameters, the examples described herein can beadapted to 3DXP devices. For example, the activation time unit 332 inFIG. 3 can, in lieu of tracking row activation times, track the timesthat the last read command and the last write command were sent to eachpartition. When a read command or an elevated write command isoutstanding to a partition P, the command selection logic, the issueunit, and/or the controller can block non-elevated write commands tothat partition. To determine the duration of time for which thecontroller can continue issuing non-elevated write commands to otherpartitions, the controller uses a time stamp at which the last readcommand and the last write command were sent to partition P. If theearliest time that the next read command can be sent to P is constrainedby the last read sent to P, the controller can continue to issuenon-elevated write commands to other partitions fort_(RD2RD SAMEPART)−t_(WR2RD DIFFPART) after the previous read command toP was issued. If the earliest time that the next read command can beissued to P is constrained by the last write command sent to P, thecontroller can continue to issue non-elevated write commands to otherpartitions for t_(WR2RD SAMEPART)−t_(WR2RD DIFFPART) after the previouswrite command to P was issued. When prioritizing an elevated writecommand, the timing parameters associated with a 3DXP device can beused. For example, if the earliest time that the next read command canbe issued to P is constrained by an elevated write command sent to P,the controller can continue to issue elevated write commands to P fort_(WR2WR SAMEPART)−t_(WR2WR DIFFPART) after the previous elevated writecommand to P was issued.

Although specific embodiments have been illustrated and describedherein, those of ordinary skill in the art will appreciate that anarrangement calculated to achieve the same results can be substitutedfor the specific embodiments shown. This disclosure is intended to coveradaptations or variations of various embodiments of the presentdisclosure. It is to be understood that the above description has beenmade in an illustrative fashion, and not a restrictive one. Combinationsof the above embodiments, and other embodiments not specificallydescribed herein will be apparent to those of skill in the art uponreviewing the above description. The scope of the various embodiments ofthe present disclosure includes other applications in which the abovestructures and methods are used. Therefore, the scope of variousembodiments of the present disclosure should be determined withreference to the appended claims, along with the full range ofequivalents to which such claims are entitled.

In the foregoing Detailed Description, various features are groupedtogether in a single embodiment for the purpose of streamlining thedisclosure. This method of disclosure is not to be interpreted asreflecting an intention that the disclosed embodiments of the presentdisclosure have to use more features than are expressly recited in eachclaim. Rather, as the following claims reflect, inventive subject matterlies in less than all features of a single disclosed embodiment. Thus,the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separateembodiment.

What is claimed is:
 1. An apparatus, comprising: a timer unit configuredto generate timestamps for activation commands provided to a memorydevice in association with implementing a command selection policy; andcommand selection logic configured to implement the command selectionpolicy by: responsive to receiving a read command, blocking a firstnumber of write commands to a bank; responsive to blocking the firstnumber of write commands, issuing, to the memory device, an activationcommand associated with the read command, wherein the read commandcomprises an address of the bank and a channel of the memory device;responsive to issuing the activation command, blocking a second numberof write commands to the channel after an expiration of a predeterminedduration of time that is based on memory device timing parameterswherein the predetermined duration of time comprises a differencebetween a row-to-column delay and a write-to-read delay; and responsiveto blocking the second number of write commands, issuing the readcommand to the memory device.
 2. The apparatus of claim 1, wherein thememory device timing parameters include the row-to-column delay, thewrite-to-read delay, and a column-to-column delay.
 3. The apparatus ofclaim 1, wherein the predetermined duration of time is selected based ona read-after-write dependence associated with the read command.
 4. Theapparatus of claim 3, wherein the command selection logic is furtherconfigured to select the predetermined duration of time to include adifference between the row-to-column delay and a column-to-column delaybased on a determination that the read-after-write dependence isassociated with the read command.
 5. An apparatus, comprising: a commandqueue to receive a read command for a bank and a channel of a memorydevice; a bank unit to provide bank addresses associated withoutstanding read commands and elevated write commands from the memorycommands; bank state unit configured to indicate a state of bankscorresponding to a memory device; and command selection logic to:determine whether there is a write command with a read-after-writedependence to the read command using the bank addresses; block a firstnumber of write commands to the bank using the bank state unit toindicate a blocking state for the bank; issue an activation commandassociated with the read command; block a second number of writecommands to the channel using the bank state unit to indicate a blockingstate for a plurality of banks in the channel; and select the writecommand and the read command for issuance based on a first-ready,first-come, first-served (FRFCFS) policy in response to determining thatthe write command has the read-after-write dependence to the readcommand.
 6. The apparatus of claim 5, further comprising a decoder todecode a bank address corresponding to the read command.
 7. Theapparatus of claim 6, wherein the command selection logic is furtherconfigured to determine whether there is the elevated write command withthe read-after-write dependence to the read command by comparing thebank to the bank addresses to determine whether the read-after-writedependence exists.
 8. The apparatus of claim 5, further comprising adecoder to decode a row address corresponding to the read command. 9.The apparatus of claim 8, the command selection logic is furtherconfigured to determine whether there is the elevated write command withthe read-after-write dependence to the read command by comparing the rowaddress to a plurality of row addresses provided by the bank unit todetermine whether the read-after-write dependence exists.
 10. A method,comprising: decoding a bank address corresponding to a bank and achannel address corresponding to a channel of a memory device from aread command received at the memory device; blocking a first number ofwrite commands to the bank; issuing an activation command associatedwith the read command; blocking a second number of write commands to thechannel; selecting the read command, from a plurality of prioritizedqueues, for issuance based on a first-ready, first-come, first-served(FRFCFS) policy in which the read command is prioritized over the firstnumber of write commands and the second number of write commands; andselecting a write command for issuance only if the write command isassociated with the read command having a read-after-write dependence.11. The method of claim 10, wherein the plurality of prioritized queuesincludes a highest priority queue comprised of column read commands. 12.The method of claim 11, wherein the plurality of prioritized queuesincludes a second highest priority queue comprised of row read commands.13. The method of claim 12, wherein the plurality of prioritized queuesincludes a third highest priority queue comprised of column writecommands.
 14. The method of claim 13, wherein the plurality ofprioritized queues include a fourth highest prioritized queue comprisedof row write commands.
 15. The method of claim 14, further comprisingselecting the read command by selecting the read command from one of thehighest priority queue or the second highest priority queue.
 16. Themethod of claim 10, further comprising selecting commands from the firstnumber of write commands and the second number of write commands forissuance before the first number of write commands are blocked.
 17. Themethod of claim 10, further comprising selecting commands from thesecond number of write commands for issuance before the second number ofwrite commands are blocked.
 18. The method of claim 10, furthercomprising selecting commands from a third number of write commandsuntil the read command is selected for issuance.
 19. A method,comprising: decoding a bank address corresponding to a bank and achannel address corresponding to a channel of a memory device from aread command received at the memory device; selecting commands from afirst number of write commands and a second number of write commands forissuance before the first number of write commands are blocked; blockingthe first number of write commands to the bank; issuing an activationcommand associated with the read command; blocking the second number ofwrite commands to the channel; and selecting the read command, from aplurality of prioritized queues, for issuance based on a first-ready,first-come, first-served (FRFCFS) policy in which the read command isprioritized over the first number of write commands and the secondnumber of write commands.
 20. A method, comprising: decoding a bankaddress corresponding to a bank and a channel address corresponding to achannel of a memory device from a read command received at the memorydevice; blocking a first number of write commands to the bank; issuingan activation command associated with the read command; selectingcommands from the second number of write commands for issuance beforethe second number of write commands are blocked; blocking a secondnumber of write commands to the channel; and selecting the read command,from a plurality of prioritized queues, for issuance based on afirst-ready, first-come, first-served (FRFCFS) policy in which the readcommand is prioritized over the first number of write commands and thesecond number of write commands.
 21. A method, comprising: decoding abank address corresponding to a bank and a channel address correspondingto a channel of a memory device from a read command received at thememory device; blocking a first number of write commands to the bank;issuing an activation command associated with the read command; blockinga second number of write commands to the channel; selecting commandsfrom a third number of write commands until the read command is selectedfor issuance; and selecting the read command, from a plurality ofprioritized queues, for issuance based on a first-ready, first-come,first-served (FRFCFS) policy in which the read command is prioritizedover the first number of write commands and the second number of writecommands.